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1  Abstract 

This  report  presents  a  summary  of  the  technical  status  for  the  period  5/1/95-7/31/95.  In 
this  period  we  passed  another  major  milestone  in  the  development  of  connectionist  network 
computers — we  completed  the  fabrication,  assembly,  and  testing  of  the  SPERT  neurocom¬ 
puting  board.  We  also  continued  to  make  significant  progress  in  system  and  application 
software  for  this  system,  in  porting  neural  network  algorithms,  and  in  the  application  of 
analog  auditory  preprocessors  to  speech  recognition. 


2  Technical  Status 

2.1  The  TO  Processor  and  SPERT  board 

As  reported  in  our  previous  status  report,  we  received  from  Hewlet  Packard  three  fabricated 
wafers  containing  the  TO,  vector  microprocessor.  Using  bare  die  tests  developed  by  us,  we 
tested  the  wafers  and  found  40%  of  the  fabricated  die  passed  the  tests.  This  percentage  is 
very  good  for  a  die  of  the  size  of  TO  (approximately  17mm  on  each  side).  Also,  as  reported 
in  the  previous  quarter,  we  are  developing  a  workstation  add-on  processor  board,  based 
on  the  TO  chip.  The  physical  realization  of  this  design  is  unique  in  that  the  TO  chip  is 
wire-bonded  directly  to  the  board,  without  the  usual  chip  package. 

This  quarter  we  installed  TO  chips  on  11  of  the  fabricated  SPERT  boards.  Five  the 
boards  where  also  fully  populated  with  all  memory  and  support  components.  The  SPERT 
boards  were  tested  using  an  inovative  test  fixture  we  developed  specifically  for  the  purpose, 
based  on  elastomeric  connector  technology.  The  completed  boards  are  fully  functional.  Hav¬ 
ing  these  SPERT  boards  working  on  the  bench  verifies  our  use  of  chip-on-board  technology 
for  a  large  die.  We  found  very  few  fabrication  problems  associated  with  the  attachment  of 
the  TO  processor  to  the  board — only  a  single  bad  wire-bond  out  of  thousands  of  total  wires. 

With  these  boards,  we  were  able  to  perform  more  complete  and  higher-speed  testing  of 
the  TO  processor.  To  date,  no  functional  errors  have  been  found  in  the  processor  design. 
The  only  known  problem  in  the  design  is  an  unusually  high  quiescent  power  draw  (250MA). 
The  high  current  draw  will  not  limit  the  usefulness  of  the  chip  and  will  be  corrected  in  later 
versions. 

The  maximum  clock  speed  for  the  TO  processor  has  been  measured  at  47MHz.  This 
is  significantly  higher  than  our  target  design  speed  of  35MHz.  This  higher  speed  can  be 
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attributed  to  our  conservative  design  verification  tools  and  techniques.  The  speed  of  SPERT 
boards  will  be  limited  by  the  commercial  SRAM  speed.  The  boards  will  be  clocked  at 
40MHz. 

Two  of  the  SPERT  boards  have  been  installed  in  workstations  for  general  use  by  our 
internal  research  community.  These  boards  have  already  enabled  research  that  would  have 
been  prohibitly  slow  on  our  other  computing  platforms.  Now,  speech  training  runs  on  small 
neural  networks  take  on  the  order  of  minutes  cis  opposed  to  hours  on  workstations. 

Based  on  our  success,  we  have  begun  the  steps  to  put  together  approximately  20  more 
SPERT  boards,  a  portion  of  which  will  be  distributed  to  other  researchers  working  in  neural 
networks  and  speech  recognition.  Towards  this  goal,  we  completed  a  revision  of  the  SPERT 
board  design  and  sent  the  design  out  to  fabrication.  We  have  also  placed  a  large  order  for 
SRAM  parts  and  expect  to  put  together  the  SPERT  systems  in  the  next  quarter. 


2.2  Softwrare 

Work  continues  on  Torrent  library  development  and  system  support. 

We  have  performed  a  series  of  experiments  to  determine  the  effects  of  fixed  point  com¬ 
putation  on  speech  recognition  neural  network  training.  The  results  show  that  we  still  have 
some  tuning  to  do  on  fixed  point  scaling  in  these  algorithms. 

In  the  area  of  high-level  software,  the  major  advance  of  this  quarter  was  the  new  release, 
1.07,  of  Sather.  Also,  we  have  setup  an  internet  homepage  to  provide  information  on  Sather 
(URL  http://www.icsi.berkeley.edu/Sather/index.html).  It  includes  tutorials  and  a  list  of 
available  technical  reports  on  Sather.  The  homepage  will  be  continuously  updated  as  new 
information  becomes  available. 

We  have  purchased  a  Myrinet  system  for  parallel  Sather  (pSather)  platform  research 
and  as  a  testbed  for  CNS-0. 


2.3  Analog  VLSI  pre-processors. 

As  described  in  the  previous  progress  reports,  we  recently  constructed  a  three-chip  sound 
pre-processing  system,  using  three  copies  of  an  enhanced  version  of  our  128-channel  spectral- 
shape  auditory  pre-processor.  We  are  using  this  system  in  pilot  experiments  in  speaker- 
independent,  telephone-quality  speech  recognition. 

We  conducted  similar  experiments  in  1994,  using  a  single-chip  front-end.  The  best 
performance  we  achieved  with  this  system  was  approximately  13%  error,  on  a  13-words 
isolated-word  task  (1-9,  ’’oh”,” zero”,  ”yes”,  ”no”),  using  a  200-speaker,  telephone  quality 
database,  and  a  standard  Hidden-Markov-Model-based  speech  recognition  system. 

Over  the  past  three  months  we  have  run  recognition  experiments  using  many  different 
configurations  of  our  three  pre- processors.  These  experiments  have  been  done  in  conjunction 
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with  a  neural-network-based  Hidden-Mar kov-Model  speech  recognition  system. 

Currently,  our  best  recognition  score  using  our  new  system  is  4.8%  error.  While  this  score 
still  falls  short  of  the  best  software-based  front-ends  (1.8%  error,  using  the  same  database 
and  testing  methods),  it  is  a  considerable  improvement  from  our  earlier  scores.  More  im¬ 
portantly,  the  error  score  is  in  the  range  of  usefulness.  Current  commercial  isolated-word 
telephone  quality  digit  recognizers  achieve  2-5%  error  performance  in  the  held,  handling  a 
vocabulary  that  is  slightly  smaller  vocabulary  (11  words)  than  our  13-word  task. 

Our  research  plan  for  the  next  quarter  is  to  continue  experiments  with  different  recogni¬ 
tion  approaches,  with  the  goal  of  further  improving  our  error  performance.  In  addition,  we 
plan  to  begin  speech  recognition  experiments  with  noise-corrupted  versions  of  our  database, 
to  explore  the  robustness  properties  of  our  front-ends. 

Dissemination  was  also  a  part  of  last  quarter:  a  presentation  of  our  multi-chip  system 
was  made  at  the  2nd  UCSD-Caltech  Joint  Symposium  on  Neural  Computation  in  La  Jolla 
on  June  15th,  and  a  paper  describing  our  system  appeared  in  the  proceedings.  A  version  of 
this  paper  was  also  submitted  to  the  NIPS  conference.  Finally,  we  have  begun  a  study  into 
possible  commercial  applications  of  our  analog  VLSI  pre-processor  research,  and  of  related 
micropower  analog  circuit  research,  in  speech  recognition. 
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